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ABSTRACT ^ 

Kohlberg^s Horal Judgment Scale, Gilligan, et al^'s 
Sexua^l Horal Judgment Scale, Haitland and Goldman's Objpctive Horal 
Judgment Scale, and H.ogan's Haturity of Hotal Judgment Scale vere 
examined for reliability and inter^scale relationshipSvAll measures 
except, the Objective Horal Judgmen-^ Scale had good reliabilities. The 
obtained relations between the Horal Judgment Scale and thV^xual 
Hbral Judgmen^t Senile replicated previous research. The Objective 
Horal Judgment Scale was not found to validly assess the Kohlbergr 
stages. The maturity of Horal Judgment Scale scores were strongly 
related to the subjects* classifiqation on the Kohlberg stages, and 
the' scale appears to offer a reliable, quickly scored, and valid 
index of mature moral thought, although the scale continuous scores 
do not permit clear stage classification, (Author) 
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■■\. ■ .■ . . ■ ■ . 

A Comparison of Four Measures ..of Moral Reasoning , ' 

\ 

The developmisnt of a cognitive theory of moral development and 
of the Moraf Judgment 'Scale . (MJS ) by "Lawrence Kohlberg (1958 & 1969) 
generated interest in moral judgment re^search. A number of instru- 
ments which report to measure either moral judgment or a trait of 
moral, judgment have since been developed. The creators of three such 
instruments have made strong claims which present thei'r instruments as 
parallel techniques of ^he.MJS. These three" measures are the, Sexual 
Moral Judgment Scale (SMJS; Gilligan, Kohlberg, Lerner, & Belenky, 
1971), an objective form of the MJS developed by Maitland and Goldman 
(OMJS; 1974), and the measure of MaturiLj.' of Moral Judgment (MMJ; 
Hogan & Dicks tein, 1972). The reported psychometric relationships 
between thes^e instruments are insubstantial. • 

The Moral Judgment Scale is a structuired, projective test consis- 
ting of a ^et of stories presenting moral dilemmas. Each dilemma is 
followed byV^a series of probing questions .\ The subject is instructed 
to both state his moral resolution of the dilemma and, more importantly, 
to state his reasons supporting this moral judgment. These responses 
are. scored for the structure of reasoning used and for th^ consistency 
of the responses. Kurtines and Grief (1974) have extensively reviewed 
the psychometric properties of the MJS. 

Gilligan, Kohlberg, Lerner, and Belenky (1971) developed the Sex- 
ual Moral Judgment Scale (SMJS) as an extension of the^ MJS . The SMJS 
has an identical format and scoring system, and it differs 'from the 
MJS only in the content area of hun>.an' affairs (Sexual relations) for 
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Scores for an adolescent sample showed that the SMJS was ^sig- i 
nificantly but moderately correlated (r=.405 for females. and r=:482 
for males) with the JVUS. Approximately 80% 'of those siabjects showing, 
any difference in level of moral reasoning differed in the direction of 
lower moral reasoning for the sexual dilemmasi^ ^ " - 

..0 

Recently, Maitland and Goldman (1974) have developed an objec- 
tive form of the HJS. Their ^scale (OMJS) attempted to eliminate the 
cumbersome administration and, scoring procedures of Kohlberg' s MJS. 
The OMJS stimulus set consists^ of fifteen moral dilemmas. Each dilem- 
ma is followed by a question designed to elicit one particular issue 
of moral judgment. Six responses, representing each of Kohlberg's 
stages, follow each question. Subjects are instructed to select the 
one response which most closely approximates their moral judgment. 
The order of presentation of the alternative moral judgments is ran- 
domized. 

The reported OMJS test-retest reliability was r=.83 for a sample 
of 12 to 19-year^olds- and r=.60 fdr'llth and 12th grade pupils. The 
split-half reliability/coefficient was r=.71 and a Kuder-Richardson-20 
yield -d an a = .6'7. "A direct validity comparison with Kohlberg's MJS 
was not conducted; ORIS scores were transformed, however, into Kohl- 
berg's moral maturity scores (MMS) by multiplying a subject's total 

OMJS score by 1(30/15. These scores were compared with the MMS norms 

- ■ ■ .. 

. for a sample of the 'same age and academic level. This comparison yiel- 

ded supportive validity data (MMS=364 and OMJS ' transformed scores=365 ) . 

Robert Hogan (1973 & 1975) constructed an alternative theory' • 

(character structure ontogenesis ), of moral development to Kohlberg's 

^ cognitive development appro.ach. Hogan and Dickstein '(1972) developed 

the Maturity <^f Moral Judgment Scale (MMJ) to determi-ne the relation- 

lilp between th^ hypothesized .character traits and moral maturity.- 



Hogan and Dickstein (1972) implicitly presented the jyiMJ as a ''briefer * 
and more readily scprable test which... would be useful... both as an 
alternative to the Kohlberg procedure and as a parallel technique..." 
(p. 210); 

The MiykJ is comprised of fifteen conversational statements which 
require 'a projective, conversational response. These responses are 
scored two points if. any one of four predefined moral concerns is 
clearly expressed: 1) concern for the sanctity of^ the individual, 

2) judgments based on the spirit rather than the letter of the law, 

3) concern for the welfare of society as a whole, and 4) capacity 
to see both sides of an issue c A response is assigned one point If 
any one' of the fou.^ concerns is' easily implied. This method yields 
a score from 0-30 for the- fifteen statements totaled. The Hoyt. com- 
putation of test reliability was reported as r=.82. There have been 
no published reports of the relationships between ^the MMJ and Kohl- 
berg's moral judgment scale. 

■ Problem Statement ' - 

The instruments described above index the same construct (moral 
reasoning) and have heen used to investigate similar research infferests 
This research is not, however^ comparable or generalizable because the 
relationships between the MJS, SMJS, OiVLJS, and lAMJ have not been sys- 
tematxcally determined. The goal of the present study is to determine 
these inter-instrument relationships . 

.The SMJS and OMJS have been administered only to pre-college age 
subjects. The,MI^ results are based on undergraduate age subjects. 
Increased intellectual and social sophistication may change the result- 
ing psychometric properties of these instruments. The sample age needs 
to be extended to post-college age (adult) subjects and comparisons 
based on a common sample age. These conditions are controlled in this 



study. The previously reported psychometric statistics will be com- . 

c 

pared to those found for this - adult sample. , , 
, Method 

Subiects 

The subjects for this study were adults enrolled in three exten- 
sion graduate courses for educators. Over 80% were actually elemen- 
tary and/or secondary teachers^ counselors, and/or administrators*. 
The age: range was 21-51 with ;the mean age being 30.4'5 years. ^ Fifty- 
seven' percent were female and -43% were male. Of the original 81 sub- 
jects, 5 weire dropped because of> incomplete data. 
Instruments ' 

MJS. The Heinz Dilemma and the Karl and Bob Stealing vs. Lieing 
Dilemma and their respective probing 'quesciorjs were chosen from Kohl- 
berg's (1974 )/Form A. ^ , 

SMJS . Dilemmas 'B' and 'C with their respective probing ques- 
tions were selected (Gilligan, Kohib^rg, Lerner^ & Belenky, 1971). » 
Story B ..examines o sex in the context of a marital relationship. It 
poses the dilemma of a husband whose wife "refuses to -have sexual inter- 
cour3e with him. Story C deals with a single woman • s pregnancy. It 
^questions the nature of the man's and woman ' s responsibility to one 
another and to\ the unborn chi.,d. 

- OMJS and MMV. These instruments were used as conftructed and 
described above. v 
Procedure 

Ail instruments were administered in a group, written form.. Each 
group of subjects was told that data was being collected fbr a study 
investigating the relationship between various^^ personality variables and 
the subjects' views on selected social issues. The MJS, SMJS , MMV, and 
OMJS were presented in a mineographed booklet which attempted to dis- 
guise their nature by being titled the "Social- Attitudes Questionnaire." 



The OMJS was presented last because an order effect .was assumed. If 
presented first, the subject would be exposed to examples of all six 

stages of moral reasoning. . - 

Results 

Instrument Reliabilities ^ 

. ' '■ ' 0 * 

The authors' interrator reliabilities on the MJS and SMJS protocols 
were examined using 'the procedure followed, by Hann, Smith, and Block 
(i968). The authors had agreement rates^ of 68% and 56% for the .two 
Kohlberg stories used to assess general moral judgment (MJS stories) . 
and agreement rates of 69% and 59% for the two stories used to measure 
sexual moral judgment (SMJS stories). Since the subjects' scores on 
the two sets of stories were highly similar., as is- discussed later, the 
four stories were combined for a single .global rating of moral judgment. 
The" rate of interrated agreement in assigning global scores was 74%. 
Protocols on which the authors disagreed or had major-minor stages re- 
versals (for example, one rater gave a subject a major stage rating of 
4 and a min6r stage rating of 3 while the other rater reversed these ^ 
major<-minor ratings) were scored. by a third rater. _ 

Since there were' few clear representatives of principled thought 
in our sample (i.e.- stages 5 or 6), all subjects scored as major stage 
five by one rater and either a major or minor stage five by the other 
rater were classified as stage five for the following analyses. For - 
the same reason, a similar . procedure was used for assigning subjects 
•to stage 2. Thus the subjects assigned to' stages 2 and 5 are^ not neces- 
sarily pure types,. but are subjects judged by both scorers as having large 
components of these stages irf their, moral thought. There were no stage 
1 or stage 6 Subjects in our sample. In the final resolution, the sub- 
jects were classified in particular stages when two ofthe three poten- 
tial judges agreed. The "distribution of the subjects is presented in 
Table I. . Q 



Maitland arid Goldman' s (1974) objective measure or the Kohlberg ^ 
stages (OMJS) had a. low alpha coefficient of .48 for the present, sample. 
The item-total correlations ranged from .09 to .52 with a median of 30. 
The alpha reliability was improved slightly to .51 by eliminating the 
least related item (item 6). Additional deletionof items did not in- 
crease the scale's reliability. - . 

Coefficients of reliability for Hogan and Dickstein ' s (1972) Mature 
Moral Judgment Scale (MMJ) were computed for each rater and for the' rat- 
er's pooled scores on each item. The alpha reliabilitiejs were .69 and 
.68 for the separate raters and .72 for the pooled scores. The alpha 
coefficient was not improved for either rater or for the combined rat- 
ings by 'deleting peripherally related items. The total scale scores 
assigned by the two raters were cofrelatedrr=.66. The average total score 
assigned by the two rat-ers for each subject was used as the best avail- 
able index of the MJyU-for comparison with the other measures. 
Relations between the four instruments . 

Similar to the findings of Gilligan, et al. (1971) there was a , 
tendency for the present subject? to think at lower stages on sexual moral 
dilemmas (SMJS stories) than on the other moral judgment stories (MJS 
stories).'* Eight of 70 classifiable subjects were judged by both . authors . 
as consistently lower on the SMJS stories than on the MJS- stories, while 
three subjects were judged as higher on the SMJS storie,s by both judges. 
An additional 16 subjects were scored . consistently lower on the SMJS 
stories by one of the judges while five additional subjects were judged 
higher on the SMJS stories by one judge. In all cases, the differences' 
between the mean scores assigned to the two sets of stories were one stage 
or less. In spite of the tendency for subjects to score .lower on the 
SMJS than on the MJS, the two instruments were correlated, r=.66. 

Since the subjects* scores on the MJS and SMJS stories were similar, 
the combined global score compiled across all of the stories served as 



the stage classification for comparison with other meas^ires. One-way 

analyses of variance were used to compute the relation b«itween the 

subjects' scores on the mor?l dilemma stories and on the- retnaining 

scales. The subjects' classification on the moral stories served as 

the independent variable in each analysis.- The six subjects who could 

not be classified were eliminated from these analyses. 

Contrary to theoretical expectations, the sub j ects ' .scoreis on the 

objective measure of Kohlberg's stages (OMJSJ were not significantly 

related to their scores on the moral\ stories (F=1.82, df=4/64, p<.15). 

• A. - 

An Omega-squared analysis revealed that only 4.4% of ^the variance in 
the OMJS scores was ascribable to the sub j ects '. classification on the 
morally ambiguous stories. According to Scheffe's Post-hoc comparison 
procedure, none of the moral stage groups h^d means which were signifi- 
cantly different from one another. A separate analysis of variance run 
with only the purer groups ( 3-4 mixtures eliminated) did not increase 

ol 

either the F ratio or the W-^ . • . . .. 

Table II presents the subjects' mean scores on the Mature, Moral 
Judgment scale as a function stage classification on the morally am- 
biguous stories (F- = 4.48, df = 4/69, p<.005.) S^age classification 
accounted for 16.7% of the variance ..in MMJ scores. When the analysis 
excluded the 3-4 mixed subjects both the F ratio and the w2 were in- 
creased substantially (F = 6.76, df = 5.51," p < .001, W2 = 23.2%). , Post- 
hoc analyses using Scheffe's test found that only the stage 2 and stage 
5 subjects differed significantly (p^.Ol). Finally,, the OMJS and the 

MMJ are not significantly correlated (r = . 17). ^ 

t 

Discussion ' i 

The patterns of relations ^between the Moral Judgement\Scale and 

1 - ■ ■ 

the' sexual Moral JucJgment Scale in the present study were very similar 
to the patterns found by Gilligan, et al. (1971). Gilligan, et al. . 
found that 80^o of the'subjects who scored at different stages on the 



two instruments were lower on the SMJS. The comparable figure for our 
Study was 73%« The two instruments were more strongly correlated in 
the present study, however* (r=.66 versus r^. 40 andf^.4a) 

Our experience confirms that the Kohlberg morally ambiguous stories 
can be scored with sufficient reliability for research purposes, but the./ 

time and effort required confirm even more strongly .the advantages of ' 

:' . , • / 

seeking good, objective measures of mature moral thought. Unfortunately, 

our daca offer little support for the objective instrument which we 

examined." 

/ The internal reliabilities for the OMJS were substantially lower 
for our sample than in Maitland and Goldman ^s ' original study.* An alpha 
of .48 is infeasibly low. We cannot account for the differences in reli- 
ability found, in the. tWQ studies^, but our obtained reliability raises 
serious doubt concerning the •usefulness of the OiVLJS. The non-significant 
relationship between the OMJS and the.Kohlberg protocols is largely as- 
cribable to the former's low reliability, ^ut this absence of relation- 
ship still shows that the OMJS does not validly assess the Kohlberg stagej 

. Our.findings for Hogan and-Dickstein' s Mature Moral Judgemept Scale 
suggest that this instrument has greater potential. Its relatiokship to 
the Kohlberg protocols is -strong, particularly so since the reliabilities 
of the two-instruments are only moderate. The reliability of the MMJ can 
b^ improved with only limited costs. For example, the present 15-item 
version can be reliably ' scored in less than five minutes. Doubling the 
length of the scale using similar items would increase its reliability 
to .83, and the scale could still, be scored with a. fraction of ±he effort 
required for scoring the Kohlberg protocols . Our data suggest, however, 
that the MMJ in its present form can bt, used as a quick, reliable, and 
valid index of mature moral thought. 



Since the M>U scores are continuous, hbwevex, the scale doe^ 
not deliniate stage boundries and it is not possible to establish 
stage classification from the MMJ. Researchers committed to the 
investigation of stages cannot use the MMJ as the primary assessment 
instrument. Researchers who do not wish to investigate stage develop-^ 
ment but rather the continuous concept of jnoral maturity should find 
Hogan's MWJ convenient for their purposes. 
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Footnote 

-^The authors are awar^ that running two analyses of variance . 
on the aane data is not app opriate acj^rding to strict statisti- 
cal criteria. The second analysis was conducted because the mixed 
stage subjects were ,not clearly classifiable and exhibited the 
greatest variance of ail the groups on both of the dependent vari- 
ables (OMJS and MJS ) , suggesting that significant relationships 
might exist between these variables and the Kohlberg stages when 
only purer stage representatives were examined. 



Table 2 



Mature Moral Judgerr^nt Scores As A Function Of Stage 
Classification On The Morally -Ambiguous Stones 



Stage " Mean 

2 • • 4.50 

3 8 . 75 
3-4 mix ■ 9.77 

4 V . 9.27 

5 12.27 
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